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ABSTRACT 



Aspects for allowing variably controlled alteration of image 
processing of digital image data in a digital image capture 
device include forming an image processing chain with two 
or more image processors to process digital image data, and 
providing one or more parametric controls within each of the 
two or more image processors. The aspects further include 
accessing chosen controls of the one or more parametric 
controls to modify the two or more image processors for 
alteration of the image processing. 

23 Claims, 8 Drawing Sheets 
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MODULAR DIGITAL IMAGE PROCESSING central processing is included within the digital image 

VIA AN IMAGE PROCESSING CHAIN WITH capture device and capable of linking the two or more image 

MODIFIABLE PARAMETER CONTROLS processors to form an image processing chain. The central 

processing unit further facilitates access of chosen controls 
RELATED APPLICATIONS 5 of the one or more parametric controls for modification of 

n.e present invention is related to co-pending U.S. patent thc two . or more toa 8 e Processors ™° Nation of the image 

application, Ser. No. 08/705,619, filed on Aug. 29, 1996, P roc *ssiog. 

entitled MODULAR DIGITAL IMAGE PROCESSING w,lh ^ present invention, processing of digital image 
VIA AN IMAGE PROCESSING CHAIN, and assigned to da,a occurs with a linked series of image processors. Each 
the assignee of the present invention. " 10 of the ima e e processors performs some level of manipula- 
te present invention is also related to co-pending U.S. tion of ihedigital imap data.Theseparationof digitalimage 
patent application, Ser. No. 08/705,588, filed on Sep. 29, P««*f«B »»«° » «™» °f image processors aUows a more 
1996, entitled FLEXIBLE DIGITAL IMAGE PROCESS- modu,ar a PP. roach lo Pressing digital image data. Further, 
ING VIA AN IMAGE PROCESSING CHAIN WITH „ '^ Present invention uniquely allows modification i of the 
MODULAR IMAGE PROCESSORS, and assigned lo the 15 *£ es th ™ u 8 b delet,on of an processor, inseruon of a 
assignee of the present invention. dlfferem una S e P roc *?° r ' or replacement of an existing 

image processor. In addition, aspects of an image processor, 

HELD OF THE INVENTION including parameter control values, are alterable in accor- 
dance with a preferred embodiment to allow greater adapt- 

The present invention relates to digital image data 20 ability to user-specific design preferences. Enhancements 

processing, and more particularly to modular digital image an( j changes to the chain are therefore easily achieved, 

data processing with modifiable parameter control. allowing greater flexibility and more convenient upgrading 

of digital image processing. 

These and other advantages of the aspects of the present 
Modern digital cameras typically include an imaging 25 invention will be more fully understood in conjunction with 
device which is controlled by a computer system. The the following detailed description and accompanying draw- 
computer system accesses raw image data captured by the i n gs. 
imaging device and then processes and compresses the data 

before storing the compressed data into an internal memory. BRIEF DESCRIPTION OF THE DRAWINGS 

The conventional digital camera captures image data and 30 * . . . . r ^- • , 

then remains unusable until the data is completely processed FIG. 1 is a block diagram of a digital camera that operates 

and stored into internal flash memory. in accordance with the present invention. 

In processing image data, typical digital cameras operate t RG - 2 * a diagram of the preferred embodiment for 

with exclusive and specific image processing. Thus, all the the ,ma S in S device of nG - L 

potential manipulations on image data, such as linearization, 35 FIG. 3 is a block diagram of the preferred embodiment for 

sharpening, and compression, occur as a result of isolated lDe computer of FIG. 1. 

preset programming and/or specifically designed hardware. FIG. 4 is a memory map showing the preferred embodi- 

While some level of manipulation of image data is rncnt of the read only memory (ROM) of FIG. 3. 

achieved with the programming or hardware, attempts to ^ FIG. 5 is a block diagram showing preferred data paths for 

alter and improve the processing are hampered by the rigid transmitting image data between components of the FIG. 3 

structure of using a single file/specific components. computer. 

Furthermore, camera functionality remains tied to technol- FIG. 6 illustrates an image processing chain of three 

ogy available at the time of the design and is not readily image processors 

replaced and updated as technology improves. Accordingly, 45 nG ? , more ific ^ , e of ^ ■ 

a need exists for a more flexible, modular approach for - n , , • 

. » . i . , . ...... processing chain. 

processing digital image data that provides enhanced digital °, . 

image output through an adaptable image processing sys- . FIG - 8 grates an image processing bacl^lane m con- 

lem " ^ junction with the image processing chain of FIG. 6. 

SUMMARY OF THE INVENTION 50 DETAILED DESCRIPTION 

Accordingly, the present invention meets these needs and The present invention relates lo a flexible, modular 

provides a method and system for allowing variably con- approach to processing of digital image data. The following 

trolled alteration of image processing of digital image data description is presented to enable one of ordinary skill in the 

in a digital image capture device. In a method aspect, thc 55 art to make and use the invention and is provided in the 

method includes forming an image processing chain with context of a patent application and its requirements. Various 

two or more image processors to process digital image data, modifications to thc preferred embodiment and thc generic 

and providing one or more parametric controls within each principles and features described herein will be readily 

of the two or more image processors. The method further apparent to those skilled in the art. 

includes accessing chosen controls of the one or more 6 o Although the following describes processing of digital 

parametric controls to modify the two or more image image data captured through a digital camera device, it is 

processors for alteration of the image processing. meant as an illustrative embodiment of the features of the 

In a system aspect, the system includes a digital image present invention. The present invention is equally capable 

capture device, the digital image capture device capable of of utilization with other devices that perform digital image 

processing digital image data through two or more image 65 data capture and processing, including, but not limited to, 

processors, the two or more image processors having one or computer systems, including those used to capture digital 

more parametric controls, and a central processing unit. The images accessible from Internet sites and image scanner 
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equipment. Further, the data structures and commands dis- of camera 110. In the preferred embodiment, CPU 344 is 

cussed with reference to a preferred embodiment are suit- capable of concurrently running multiple software routines 

ably included as part of high level code used directly by one to control the various processes of camera U0 within a 

or more applications that is readily achieved through the use multi-threading environment. DRAM 346 is a contiguous 

of C, C++, or other similar programming language, and 5 block of dynamic memory which may be selectively allo- 

stored on a computer readable medium. cated to various storage functions. 

A digital camera architecture has been disclosed in I/O 348 is an interface device allowing communications 

co-pending U.S. patent application Ser. No. 08/666,241, to and from computer 118. For example, I/O 348 permits an 

entitled "A System And Method For Using A Unified external host computer (not shown) to connect to and 

Memory Architecture To Implement A Digital Camera 10 communicate with computer 118. I/O 348 also permits a 

Device," filed oo Jun. 20, 1996, and assigned to the Assignee camera HO user to communicate with camera 110 via an 

of the present application. The Applicant hereby incorpo- external user interface and via an external display panel, 

rates the co-pending application by reference, and repro- referred to as a view finder. 

duces portions of that application herein with reference to ROM 350 typically comprises a conventional nonvolatile 

FIGS. 1-5 for convenience. 15 read-only memory which stores a set of computer-readable 

Referring now to FIG. 1, a block diagram of a camera 110 program instructions to control the operation of camera 110. 

is shown according to the present invention. Camera 110 ROM 350 is further discussed below in conjunction with 

preferably comprises an imaging device 114, a system bus FIG. 4. Removable memory 354 serves as an additional 

116 and a computer 118. Imaging device 114 is optically image data storage area and is preferably a non-volatile 

coupled to an object 112 and electrically coupled via system 20 device, readily removable and replaceable by a camera 110 

bus 116 to computer 118. Once a photographer has focused user via buffers/connector 352. Thus, a user who possesses 

imaging device 114 on object 112 and, using a capture several removable memories 354 may replace a full remov- 

button or some other means, instructed camera 110 to able memory 354 with an empty removable memory 354 to 

capture an image of object 112, computer 118 commands effectively expand the picture-taking capacity of camera 

imaging device 114 via system bus 116 to capture raw image 25 110. In the preferred embodiment of the present invention, 

data representing object 112. The captured raw image data is removable memory 354 is typically implemented using a 

transferred over system bus 116 to computer 118 which flash disk. 

performs various image processing functions on the image Power supply 356 supplies operating power to the various 

data before storing it in its internal memory. System bus 116 components of camera HO. In the preferred embodiment, 

also passes various status and control signals between imag- 30 power supply 356 provides operating power to a main power 

ing device 114 and computer 118. bus 362 and also to a secondary power bus 364. The main 

Referring now to FIG. 2, a block diagram of the preferred power bus 362 provides power to imaging device 114, I/O 

embodiment of imaging device 114 is shown. Imaging 348, ROM 350 and removable memory 354. The secondary 

device 114 preferably comprises a lens 220 having an iris, a 35 power bus 364 provides power to power manager 342, CPU 

filter 222, an image sensor 224, a timing generator 226, an 344 and DRAM 346. 

analog signal processor (ASP) 228, an analog-to-digital Power supply 356 is connected to main batteries 358 and 

(A/D) converter 230, an interface 232, and one or more also to backup batteries 360. In the preferred embodiment, 

motors 234. a camera 110 user may also connect power supply 356 to an 

U.S. patent application Ser. No. 08/355,031, entitled "A ^ external power source. During normal operation of power 

System and Method For Generating a Contrast Overlay as a supply 356, the main batteries 358 provide operating power 

Focus Assist for an Imaging Device," filed on Dec. 13,1994, to power supply 356 which then provides the operating 

is incorporated herein by reference and provides a detailed power to camera 110 via both main power bus 362 and 

discussion of the preferred elements of imaging device 114. secondary power bus 364. 

Briefly, imaging device 114 captures an image of object 112 45 During a power failure mode in which the main batteries 

via reflected light impacting image sensor 224 along optical 358 have failed (when their output voltage has fallen below 

path 236. Image sensor 224 responsively generates a set of a minimum operational voltage level) the backup batteries 

raw image data representing the captured image 112. The 360 provide operating power to power supply 356 which 

raw image data is then routed through ASP 228, A/D then provides the operating power only to the secondary 

converter 230 and interface 232. Interface 232 has outputs 50 power bus 364 of camera 110. Selected components of 

for controlling ASP 228, motors 234 and timing generator camera 110 (including DRAM 346) are thus protected 

226. From interface 232, the raw image data passes over against a power failure in main batteries 358. 

system bus 116 to computer 118. p 0W er supply 356 preferably also includes a flywheel 

Referring now to FIG. 3, a block diagram of the preferred capacitor connected to the power line coming from the main 

embodiment for computer 118 is shown. System bus 116 55 batteries 358. If the main batteries 358 suddenly fail, the 

provides connection paths between imaging device 114, flywheel capacitor temporarily maintains the voltage from 

power manager 342, central processing unit (CPU) 344, the main batteries 358 at a sufficient level, so that computer 

dynamic random-access memory (DRAM) 346, input/ 118 can protect any image data currently being processed by 

output interface (I/O) 348, read-only memory (ROM) 350, camera 110 before shutdown occurs, 

and buffers/connector 352. Removable memory 354 con- 60 Referring now to FIG. 4, a memory map showing the 

nects to system bus 116 via buffers/connector 352. preferred embodiment of ROM 350 is shown. In the pre- 

Alternately, camera 110 may be implemented without ferred embodiment, ROM 350 includes control application 

removable memory 354 or buffers/connector 352. 400, toolbox 402, drivers 404, kernal 406 and system 

Power manager 342 communicates via line 366 with configuration 408. Control application 400 comprises pro- 
power supply 356 and coordinates power management 65 gram instructions for controlling and coordinating the vari- 
operations for camera 110. CPU 344 typically includes a ous functions of camera 110. Toolbox 402 contains selected 
conventional processor device for controlling the operation function modules including memory manager 410, RAM 
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spooler 1 (412), RAM spooler 2 (414), removable memory conversion of the image data from an eight-bit non-linear 

spooler 1 (416), removable memory spooler 2 (418), image space to sixteen-bit linear space. As a more specific 

processing and compression 420 and file system 422. example, input pixels stored as eight bit compressed Bayer 

Referring now to FIG. 5, a block diagram showing pattern image data are converted through linearization image 

preferred data paths for transmitting image data between 5 processor 502a into sixteen bit extended Bayer pattern 

selected computer 118 components is shown. In FIG. 5, image data. 

frame buffer 536 receives and stores raw image data previ- A next suitable image processor S02b is a bad pixel 

ously captured by image device 114. Frame buffer 536 then replacement processor. Bad pixel replacement suitably 

transfers control of the raw image data to RAM spooler 1 occurs lhrou S h interpolation of the neighborhood pixels 

(412) via line 610. Alternatively, if RAM disk 532 is full, 10 around ^defective CCD pixels. Hie processing by image 

frame buffer 536 may transfer control of the raw image data Processor 502* capably receives and outputs pixel data in 

t . t J , « A . .. sixteen-bit linear space Bayer format. 

m S D Axx mage P ro( f^^ com P ression ™ luje As a next image processor 502, white balance processor 

612. If RAM spooler 1 (412) receives control of the raw 5Q2c forms * h £ { processing . & xd data 

unage data it then stores the raw image data into RAM disk received . and output by lhe white balance ^ proC essor 

532 using line 614. 15 502c are appropriately stored in sixteen-bit linear space 

Removable memory spooler 1 (416) may then access the Bayer format, 

raw image data from RAM disk 532 via line 616 and store A fourth image processor S02d preferably performs image 

it into removable memory 354 using line 618. Alternatively, color or color filter array data (CFA) reconstruction. By way 

if removable memory 354 is full or is not inserted, RAM of example, the CFA reconstruction image processor 502d 

disk 532 may provide the raw image data directly to image 20 suitably achieves an interpolation operation to convert 

processing/compression 420 using line 620. If removable sixteen-bit Bayer CFA pattern CCD data into a forty-eight 

memory spooler 1 (416) stores the raw image data into bit extended RGB image. 

removable memory 354, then image processing/ Following CFA reconstruction image processor 502*/, 

compression 420 typically accesses the stored raw image color transformation image processor 502<? is included. An 

data using line 622. 25 appropriate color transformation image processor 502e 

LINKJNG IMAGE PROCESSORS FOR FORMING employs a color correction matrix, such as to convert from 

IMAGES device-dependent camera color space to device-independent 

In the preferred embodiment, image processing and com- linear CCIR709 color space. Preferably, the input and output 

pression 420 occurs via an image processing chain (IPC). pixel data is stored in forty-eight bit extended RGB format. 

For purposes of this discussion, the IPC preferably refers to 30 As a next image processor, YCC color space transforma- 

a software process that manipulates image data in a stage by tion image processor 502/ is included. Hie YCC color space 

stage fashion. As shown in FIG. 6, an IPC 500 is suitably conversion image processor 502/ suitably uses CCIR 601-2 

composed of a sequence of image processors 502 with each specification to create an eight -bit YCrCb image from an 

image processor 502 performing a particular type of image RGB image. Input pixel data to image processor 502/ is 

transformation. The input image data 504 is suitably 35 suitably given in forty-eight bit extended RGB format with 

received from a single image source and output as output output pixel data in twenty-four bit YCrCb444 format, 

image data 506 into a single image destination. Image Two additional image processors 502 in the IPC 500 

processors suitably refer to software modules that apply include sharpening image processor 502g and JPEG com- 

algorilhms on image data to obtain a special image process- pression image processor 502/i. Sharpening image processor 

ing result, specific examples of which are described below 40 502g suitably receives input pixel data in twenty-four bit 

with reference to FIG. 7. YCrCb format and outputs pixel data in the same format 

FIG. 7 illustrates the IPC 500 with several examples of the after performing sharpening operations. Parameter control 

image processors 502 capable for utilization as the IPC 500. of the sharpening suitably occurs with a range of values for 

For each of the image processors 502, an unambiguous the sharpening operation. 

image data format is specified for the input and output data. 45 The JPEG compression image processor S02h suitably 
When the input and output image data formats are the same, performs JFIF base line image compression. Input pixel data 
the image processor 502 is considered non-transforming, in twenty-four bit YCrCb444 format is output from image 
examples of which are represented by the rounded boxes in processor 502A as compressed and subsampled YCC format, 
FIG. 7. Conversely, image processors 502 that do not have 48-bit YCrCb411 per 4-pixel data. Two forms of parameter 
the same input and output data formats are suitably consid- 50 controls are achieved via image processor 502/i to both 
ered transforming, e.g., the rectangles of FIG. 7. Although control the degree of compression, e.g., maximum to normal 
the following description of FIG. 7 is given with a particular to lossless, and to identify data as color or grayscale, 
order and series of image processors for image processing to Coordination of the image processors 502 to form the IPC 
occur in a sequential and serial manner, it should be appre- 500 is preferably done via an image processing backplane 
ciated that in the preferred embodiment, any number of 55 (IPB). In a preferred embodiment, the image processing 
non-transforming image processors may be chained between backplane provides processing support in a broad manner to 
two separate transforming image processors. Further, brief allow varying algorithms to be incorporated as image pro- 
descriptions of the type of image processing capable by each cessors 502. The features of the processing support by the 
image processor 502 are included as examples. However, the IPB are described in more detail with reference to FIG. 8 and 
details of such processing are not included in the present 60 include performing image scan line buffer input/output 
discussion and are considered to be well understood by those (I/O), IPC construction and connection, image processor 
skilled in the art. Thus, image processing through the use of parameter control setting, single pass through image data, 
other image processors in the IPC 500 is within the spirit and procedural interface to the image processors, circular data 
scope of the present invention. pipeline support, and ring-pixel handling, with minimal 

The image processors 502 suitably include a first image 65 memory requirements and overheads, 

processor 502a for linearization of the input image data 504. FIG. 8 illustrates schematically an IPB 520 in conjunction 

By way of example, linearization refers to a straightforward with an IPC 500 including two image processors 502. 
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Suitably, internal data structures, e.g., IPBImageBuf 522 and 
IPBNode 524, are maintained by the IPB 520 for storing 
information related to the image processors 502 during 
processing and are connected indirectly in terms of data 
flow, as indicated by the dashed arrows in FIG. 8. The 
information maintained by the data structures 522 and 524 
preferably includes locations of the input and output line 
buffers, and internal state and functional routine entry point- 
ers of each image processor 502. Thus, data structure 522 
capably contains pointers pointing to image scan line buffers 
526 that are used to store input and output image data in 
formats suitably determined during installation of an image 
processor 502. More particularly, the image scan line buffers 
526 preferably store one or more image scan lines, i.e., the 
lines of data forming a data pipeline that consists of the 
minimum number of lines required by an image processor 
502. 

For image processors 502, processing suitably occurs 
with a data pipeline that contains a single image scan line, 
i.e., an image pixel line in the fast scan direction from left 
to right. However, some image processors 502, such as 
compression image processors (e.g., 502A, FIG. 7), utilize 
more than one scan line during processing to take neigh- 
boring effects into account. When more than one scan line is 
needed by an image processor 502, a data pipeline is suitably 
defined for convenience at the input end of the image 
processor 502. For purposes of this discussion, a data 
pipeline refers to a minimum collection of image scan lines 
required by an image processor 502, Generally, a data 
pipeline includes an image scan line currently being 
processed, and some number of image scan lines prior to 
('lookback') and/or after ('lookahead') the current image 
scan line. Suitably, access to the data pipeline occurs via a 
circular array of buffer pointers, so that after each processing 
iteration of the image processor 502, the pointers in the array 
are circularly rotated, as is well understood by those skilled 
in the art. In contrast to prior devices that typically require 
large amounts of memory to perform image data 
manipulations, the image scan line buffers provide sufficient 
memory to perform processing one scan line at a lime, thus 
reducing the overall memory requirements without reducing 
processing capabilities. 

Preferably, the data pipeline required by an image pro- 
cessor 502 is indicated during the installation of the image 
processor 502 in the IPC 500. Installation of an image 
processor 502 suitably occurs when the camera first starts up 
with an IPC 500 constructed from all of the default image 
processors 502 stored in the system ROM. Suitable func- 
tions to coordinate the construction and deconstruction of 
the IPC 500 include four functions, an initialization 
function, e.g., IPCInit, an installation function, e.g., 
I PCI nstall I mage Processor, a connection function, e.g., 
IPCConnect, and a destruction function, e.g., IPCDeslroy. 

The IPC initialization function is called to create a new 
IPC 500. A suitable default IPC 500 converts raw CCD 
capture data into a JPEG compressed image. Preferably, the 
IPC initialization function returns a reference to a new 
image processing chain, identifies types of image processors 
included in the chain, and specifies a maximum expected 
width in pixels to be sent through the IPC, where the 
maximum width includes ring-pixels, which refer to supple- 
mentary image data at each side of the image required by an 
image processor to perform a particular algorithm. 

The IPC installation function is called by an image 
processing application to the IPB 520 to install the image 
processor 502 into the IPC 500. Preferably, the installation 
function specifies an IPC reference number, as identified in 



the initialization function, and provides pointers to the seven 
functional routine entries, as discussed hereinbelow, of the 
image processor being installed. 
The IPC connection function specifies an IPC reference 

5 number, and signals to the IPB 520 that all image processors 
502 have been installed and that the IPC 500 contains all the 
required image processors 502 to perform image processing. 
The IPC destruction function specifies an IPC reference 
number and is called to destroy an IPC 500. Although a 

10 default camera IPC 500 is unlikely to be destroyed, other 
IPCs added to a camera for other purposes, by functions in 
accordance with a preferred embodiment and discussed in 
more detail hereinbelow, are suitably destroyed with this 
function. 

is MODULARITY OF IMAGE PROCESSORS THROUGH 
FLEXIBLE UPDATING OF AN IPC 

Alterations to an existing IPC 500 readily occur in a 
preferred embodiment through an update function, e.g., 
IPBUpdateDefau UIPC, that specifies the IPC reference num- 

20 ber for the IPC 500 being updated/modified. Updating of an 
IPC 500 includes insertion of an image processor 502 to the 
IPC 500, deletion of an image processor 502 from the IPC 
500, or replacement of an image processor 502 with an 
alternate image processor 502. Preferably, the default IPC 

25 500 is updated via an image processor module on a storage 
device, e.g., removable memory, RAM disk, or internal 
memory. The image processor module suitably contains one 
or more plug-in image processors that each have one addi- 
tional function, e.g., IPMPluglnProc, that defines the updat- 

30 ing strategy, the signature of the target image processor to be 
updated, and pointers of the seven basic functions of an 
image processor, as described hereinbelow. Lack of identi- 
fication of valid target image processors in an IPC or lack of 
match between the format of the output of one image 

35 processor and input of a next image processor chained 
together preferably results in cancellation of the updating 
attempt and restoration of the default IPC 500. 

Defining an image processor 502, for use in a default IPC 
500 or as an updating image processor, suitably occurs 

40 through seven functional routines or procedures, as indi- 
cated by block 528 in FIG. 8. A definition function, e.g., 
IPDefineProc, allows an image processor 502 to specify its 
characteristics. It is appropriately called by the IPB 520 
when the image processor 502 is installed into the IPC 500 

45 to identify the characteristics of the image processor 502 . By 
way of example, for an image processor 502 that performs 
color correction via a 3x3 matrix, input and output formats 
of 48 bit extended RGB are capably identified by the 
definition function. Further characteristics identified include 

50 the configuration of the data pipeline associated with the 
image processor 502, the number of ring-pixels, and the 
number of parameter controls. 

An initialization function, e.g., IPInitProc, appropriately 
allows an image processor 502 to allocate any internal 

55 storage it might need when processing an image. It is 
suitably called by the IPB 520 only once when the image 
processor 502 is installed into the IPC 500. Subsequent calls 
to the other five functions described below then pass the 
internal storage space allocated by the IPInitProc as an 

60 argument. Further identified by the initialization function is 
the maximum width specification of an image scan fine in 
pixels that is expected at the input, including ring-pixels at 
both the left and right sides. In the example of defining the 
color correction image processor, the initialization function 

65 capably identifies a memory location storing a pointer to 
needed 3x3 matrix constant value internal variables, and the 
maximum width. 
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Two functions, a control function, e.g., IPControlProc, IPBGetParameterCapability, IPBGetDefauItParameter, and 

and a status function, e.g., IPStatusProc, deal with parameter IPBGetParameter. Also included are functions for setting or 

controls of an image processor 502. Preferably, parameter restoring parameter control values, e.g., 

controls for an image processor 502 each have a unique IPBSetDefaultParameter, IPBSetParameter, and IPBRe- 

4-character tag that is registered to avoid conflict. Parameter 5 storeParameter. Preferably, for the parameter control value 

control values include two types, a range type and an determination functions, an IPC 500 and the number of 

enumerated list type. Range types of parameter control parameters requested are identified, as well as identification 

values are appropriately confined between the minimum and of a P° inter t0 an arrav of P a rameter tags, a pointer to a 

maximum settings for the range. Enumerated list parameter memory location used to store a pointer for the parameter 

control values assign different enumerated numbers to dif- 10 «^gs returned, and a pointer to a memory location where 

ferent settings with a 32-character null terminated string lhe number of b y tes of Peeler control values are stored, 

used to provide an ASCII name for each enumerated list Similarly, for the capability determination function, an IPC 

number. Examples of parameter controls include sharpening « specified, the number of parameters requested is specified, 

values (range type), color specification control values (range a P oinler t0 M m y of parameter tags is specified, a pointer 

type), and compression control values (enumerated list is t0 a memory location used to store a pointer for the param- 

type). J " eter capability information returned is specified, and a 

The control function, IPControlProc, is called by the IPB P oinler t0 a memory location where the number of bytes of 
520 to control the processing parameters one parameter parameter capability information is stored is specified. Thus, 
control at a time and only before a reset function, e.g., access to the parameter controls managed by an IPC 500 are 
IPReset, call for every image to be processed. The status 20 available, as well as current values, device dependent lac- 
function, IPStatusProc, allows an image processor 502 tor y default vaIues > and user-specified default values, 
called by the IPB 520 to determine any parameter kind, For tbe parameter control value setting functions, prefer- 
values types, factory default parameter setting, and current abl y identified by the functions are an IPC, a number of 
parameter setting of an image processor 502. No-operation parameter control values to be set, and a pointer to a list of 
routines are provided when the image processor does not 25 Parameter tags and either a current value or a user default 
support any parameter settings, such as in the example of the value lhal m to be ^ b y the Unction. In addition, the set 
color correction image processor. parameter function appropriately allows all parameters not 

The reset function, IPResetProc, suitably allows IPB 520 listcd in lhc specified parameter value list to be reset to their 
to signal an image processor 502 to reset any internal user default value whcD a Booleao variable * ^ 
variables used by the image processor 502 before every 30 restoration function similarly identifies an IPC and a number 
image is processed. With the color correction image proccs- of parameters to be requested, provides a pointer to an array 
sor example, no operation routines are provided, since no of Parameter tags, and selects the type of parameter defaults, 
local variables need to be reset. A process function, e.g., i e - user-specified or device dependent factory, being reset 
IPProcessProc, suitably allows an image processor 502 to lhrou g h a Boolean variable. Iliese functions therefore pro- 
process image data one scan line at a time. It is suitably 35 vide convenient accessibility to allow alteration of param- 
called whenever a data pipeline for the image processor 502 eter values in an IPC 500. Greater flexibility for 
fills up. Thus, the operations for performing the 3x3 matrix adjusting an image processor 502 within an IPC 500 is 
manipulation in the color correction image processor advantageously provided. 

example, are specified with the process function. A destmc- Although the present invention has been described in 

tion function, e.g., IPDestroyProc, suitably allows an image 40 accordance with the embodiments shown, one of ordinary 

processor to deallocate any internal storage allocated at sklU in tbe art ^ recognize that there could be variations 

initialization. It is appropriately called when the IPC 500 10 lhe embodiment and those variations would be within the 

containing the image processor 502 is being removed. In s P irit and of mc P rcscDt invention. Accordingly, many 

response to this call, the image processor 502 preferably modifications may be made by one of ordinary skill without 

deallocates internal storage aUocated in the initialization 45 departing from the spirit and scope of the present invention, 

function call. tbe ^P 6 °f which is defined by the following claims. 

Entry points to these seven functional routines for an Wnal K claimed is: 

image processor 502, stored in an external data structure, 1 A method for allowin S variabl y controlled alteration of 

e.g., Functions, as well as the characteristics of the image processing of digital image data in a digital image 

processor 502, are suitably stored in an internal data 50 ca P mre device > melhod comprising: 

structure, e.g., ImageProc, by the IPB 520. Once the image forming an image processing chain with two or more 

processors 502 are defined through the seven functional image processors, the two or more image processors 

routines and connected in an IPC 500, the IPB 520 suitably °eing stored in memory, wherein said processors are 

facilitates image processing operations by managing image software modules and each performing a particular type 

buffer I/O, and activation of each image processor 502 as 55 of "^ge transformation, to process digital image data; 

soon as enough input data has been collected. The informa- providing one or more parametric controls that are 

tion for the image data processed is suitably stored in a data uniquely identified and within each of the two or more 

structure, e.g., Imagelnfo, including raw image size captured image processors; and 

by a camera CCD, final processed output image size, bad accessing chosen controls of the one or more parametric 

pixel locations, etc. 60 controls within each of the two or more image proces- 

MODIFIABLE PARAMETER CONTROL OF IMAGE sors to modify the two or more image processors for 

PROCESSOR IN AN IPC alteration of the image processing. 

In a preferred embodiment, the IPB 520 further provides 2. The method of claim 1 wherein the step of accessing 

routines to allow exchanges of parameter control settings by further comprises altering a default value of the one or more 

an external mechanism, such as a control application 400 65 parametric controls. 

(FIG. 4). These functions include parameter control capa- 3. The method of claim 2 wherein the step of altering 

bility and value determination functions, e.g., further comprises setting the default value to a desired value. 
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4. The method of claim 2 wherein the step of altering 
further comprises resetting the default value to a device 
dependent factory value. 

5. The method of claim 1 wherein the step of accessing 
further comprises determining current values of the one or 
more parametric controls. 

6. The method of claim 1 wherein the step of accessing 
further comprises determining default values of the one or 
more parametric controls. 

7. The method of claim 1 wherein the step of accessing 
further comprises determining parametric control capabili- 
ties of the one or more parametric controls. 

8. The method of claim 7 wherein the step of determining 
parametric control capabilities further comprises providing 
values, value types, and device dependent factory default 
values. 

9. The method of claim 1 wherein the two or more image 
processors further comprise a sharpening image processor 
and a compression image processor. 

10. The method of claim 9 wherein the sharpening image 
processor provides a sharpening parametric control. 

11. The method of claim 10 wherein the sharpening 
parametric control comprises a range type of control. 

12. The method of claim 9 wherein the compression 
image processor provides a compression parametric control 
and a color specification control. 

13. The method of claim 12 wherein the compression 
parametric control comprises an enumerated list type of 
control. 

14. The method of claim 12 wherein the color specifica- 
tion parametric control comprises a range type of control. 

15. A system for allowing variably controlled alteration of 
image processing of digital image data, the system compris- 
ing: 

a digital image capture device, the digital image capture 
device capable of processing digital image data through 
two or more image processors, the two or more image 
processors being stored in memory, wherein said pro- 
cessors are software modules and each performing a 
particular type of image transformation and having one 
or more parametric controls that are uniquely identi- 
fied; and 

a central processing unit within the digital image capture 
device and capable of linking the two or more image 
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processors to form an image processing chain, wherein 
the central processing unit facilitates access of chosen 
controls of the one or more parametric controls within 
each of the two or more image processors for modifi- 
5 cation of the two or more image processors and alter- 
ation of the image processing. 
16. The system of claim 15 wherein the two or more 
image processors further comprise a sharpening image pro- 
cessor and a compression image processor. 
10 17. The system of claim 15 wherein the central processing 
unit facilitates altering a default value of the one or more 
parametric controls. 

18. The system of claim 15 wherein the central processing 
15 unit facilitates setting the default value to a desired value. 

19. The system of claim 15 wherein the central processing 
unit facilitates resetting the default value to a device depen- 
dent factory default value. 

20. The system of claim 15 wherein the central processing 
20 unit facilitates determining current values of the one or more 

parametric controls. 

21. The system of claim 15 wherein the central processing 
unit facilitates determining default values of the one or more 
parametric controls. 

25 22. The system of claim 15 wherein the central processing 
unit facilitates determining parametric control capabilities of 
the one or more parametric controls, including values, value 
types, and device dependent factory default values. 
23. A computer readable medium containing program 
30 instructions for: 

forming an image processing chain with two or more 
image processors, the two or more image processors 
stored in memory, wherein said processors are software 
modules and each performing a particular type of 
35 image transformation, to process digital image data; 
providing one or more parametric controls that are 
uniquely identified and within each of the two or more 
image processors; and 
accessing chosen controls of the one or more parametric 
4 controls within each of the two or more image proces- 
sors to modify the two or more image processors for 
alteration of the image processing. 

* * * * * 
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